PS-FCN: A Flexible Learning Framework for Photometric Stereo

This paper addresses the problem of photometric stereo for non-Lambertian surfaces. Existing approaches often adopt simplified reflectance models to make the problem more tractable, but this greatly hinders their applications on real-world objects. In this paper, we propose a deep fully convolutional network, called PS-FCN, that takes an arbitrary number of images of a static object captured under different light directions with a fixed camera as input, and predicts a normal map of the object in a fast feed-forward pass. Unlike the recently proposed learning based method, PS-FCN does not require a pre-defined set of light directions during training and testing, and can handle multiple images and light directions in an order-agnostic manner. Although we train PS-FCN on synthetic data, it can generalize well on real datasets. We further show that PS-FCN can be easily extended to handle the problem of uncalibrated photometric stereo.Extensive experiments on public real datasets show that PS-FCN outperforms existing approaches in calibrated photometric stereo, and promising results are achieved in uncalibrated scenario, clearly demonstrating its effectiveness.Comment: ECCV 2018: https://guanyingc.github.io/PS-FC

Embedded polarizing filters to separate diffuse and specular reflection

Polarizing filters provide a powerful way to separate diffuse and specular reflection; however, traditional methods rely on several captures and require proper alignment of the filters. Recently, camera manufacturers have proposed to embed polarizing micro-filters in front of the sensor, creating a mosaic of pixels with different polarizations. In this paper, we investigate the advantages of such camera designs. In particular, we consider different design patterns for the filter arrays and propose an algorithm to demosaic an image generated by such cameras. This essentially allows us to separate the diffuse and specular components using a single image. The performance of our algorithm is compared with a color-based method using synthetic and real data. Finally, we demonstrate how we can recover the normals of a scene using the diffuse images estimated by our method.Comment: ACCV 201

On the well-posedness of uncalibrated photometric stereo under general lighting

Uncalibrated photometric stereo aims at estimating the 3D-shape of a surface, given a set of images captured from the same viewing angle, but under unknown, varying illumination. While the theoretical foundations of this inverse problem under directional lighting are well-established, there is a lack of mathematical evidence for the uniqueness of a solution under general lighting. On the other hand, stable and accurate heuristical solutions of uncalibrated photometric stereo under such general lighting have recently been proposed. The quality of the results demonstrated therein tends to indicate that the problem may actually be well-posed, but this still has to be established. The present paper addresses this theoretical issue, considering first-order spherical harmonics approximation of general lighting. Two important theoretical results are established. First, the orthographic integrability constraint ensures uniqueness of a solution up to a global concave-convex ambiguity , which had already been conjectured, yet not proven. Second, the perspective integrability constraint makes the problem well-posed, which generalizes a previous result limited to directional lighting. Eventually, a closed-form expression for the unique least-squares solution of the problem under perspective projection is provided , allowing numerical simulations on synthetic data to empirically validate our findings

Solving Uncalibrated Photometric Stereo using Total Variation

International audienceEstimating the shape and appearance of an object, given one or several images, is still an open and challenging research problem called 3D-reconstruction. Among the different techniques available, photometric stereo (PS) produces highly accurate results when the lighting conditions have been identified. When these conditions are unknown, the problem becomes the so-called uncalibrated PS problem, which is ill-posed. In this paper, we will show how total variation can be used to reduce the ambiguities of uncalibrated PS, and we will study two methods for estimating the parameters of the generalized bas-relief ambiguity. These methods will be evaluated through the 3D-reconstruction of real-world objects

Magnetic field spectral evolution in the inner heliosphere

Parker Solar Probe and Solar Orbiter data are used to investigate the radial evolution of magnetic turbulence between 0.06 ≲ R ≲ 1 au. The spectrum is studied as a function of scale, normalized to the ion inertial scale di. In the vicinity of the Sun, the inertial range is limited to a narrow range of scales and exhibits a power-law exponent of, αB = −3/2, independent of plasma parameters. The inertial range grows with distance, progressively extending to larger spatial scales, while steepening toward a αB = −5/3 scaling. It is observed that spectra for intervals with large magnetic energy excesses and low Alfvénic content steepen significantly with distance, in contrast to highly Alfvénic intervals that retain their near-Sun scaling. The occurrence of steeper spectra in slower wind streams may be attributed to the observed positive correlation between solar wind speed and Alfvénicity

Exploring the Solar Wind from Its Source on the Corona into the Inner Heliosphere during the First Solar Orbiter-Parker Solar Probe Quadrature

This Letter addresses the first Solar Orbiter (SO)–Parker Solar Probe (PSP) quadrature, occurring on 2021 January 18 to investigate the evolution of solar wind from the extended corona to the inner heliosphere. Assuming ballistic propagation, the same plasma volume observed remotely in the corona at altitudes between 3.5 and 6.3 solar radii above the solar limb with the Metis coronagraph on SO can be tracked to PSP, orbiting at 0.1 au, thus allowing the local properties of the solar wind to be linked to the coronal source region from where it originated. Thanks to the close approach of PSP to the Sun and the simultaneous Metis observation of the solar corona, the flow-aligned magnetic field and the bulk kinetic energy flux density can be empirically inferred along the coronal current sheet with an unprecedented accuracy, allowing in particular estimation of the Alfvén radius at 8.7 solar radii during the time of this event. This is thus the very first study of the same solar wind plasma as it expands from the sub-Alfvénic solar corona to just above the Alfvén surface

P2Y receptors and pain transmission

It is widely accepted that the most important ATP receptors involved in pain transmission belong to the P2X3 and P2X2/3 subtypes, selectively expressed in small diameter dorsal root ganglion (DRG) neurons. However, several types of the metabotropic ATP (P2Y) receptors have also been found in primary afferent neurons; P2Y1 and P2Y2 receptors are typically expressed in small, nociceptive cells. Here we review the results available on the involvement of P2Y receptors in the modulation of pain transmission

Evidence for electron Landau damping in space plasma turbulence

How turbulent energy is dissipated in weakly collisional space and astrophysical plasmas is a major open question. Here, we present the application of a field-particle correlation technique to directly measure the transfer of energy between the turbulent electromagnetic field and electrons in the Earth's magnetosheath, the region of solar wind downstream of the Earth's bow shock. The measurement of the secular energy transfer from the parallel electric field as a function of electron velocity shows a signature consistent with Landau damping. This signature is coherent over time, close to the predicted resonant velocity, similar to that seen in kinetic Alfven turbulence simulations, and disappears under phase randomisation. This suggests that electron Landau damping could play a significant role in turbulent plasma heating, and that the technique is a valuable tool for determining the particle energisation processes operating in space and astrophysical plasmas.STFC Ernest Rutherford Fellowship [ST/N003748/2]; NASA HSR grant [NNX16AM23G]; NSF CAREER Award [AGS-1054061]; NASA HGI grant [80NSSC18K0643]; NASA MMS GI grant [80NSSC18K1371]Open access journalThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at [email protected]